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ABSTRACT 


Different strategies can be used to search for a moving 


object. 

If the searcher's action at each time unit maximizes his 
chances of immediate detection, his strategy is said to be 
myopic. If, however, the searcher seeks to allocate search 
effort to maximize the probability of detecting the traget 
within a preset amount of time, his strategy is called 
optimal. 

This thesis documents interactive computer programs that 
are useful for testing search strategies against the myopic 
strategy, and shows examples where the myopic strategy is 


not optimal. 
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I. INTRODUCTION 


A search is an operation with the purpose of finding an 
object (target) that will in the thesis be assumed to move 
during the search. 

In general, it will be assumed that the target is within 
an area that can be partitioned into a finite number of cells, 
moving from one cell to another at fixed time intervals 
(periods). The actual path that the object follows, when- 
ever it moves, is unknown but the probabilistic distribution 
of all possible paths is given. It is assumed that the cells 
which the target will occupy in the future depend only on 
the cell it is in at the present time but not on how it got 
there (markovian motion). 

If the searcher allocates his resources to maximize the 
chances of immediate detection, his search plan is said to 
be myopic. If, however, he seeks to allocate search effort 
tO maximize the probability of detection within a preset 
amount of time, his plan is called optimal. 

In an important class of naval search problems, the 
target probabilistic distribution over space, i.e., the initial 
probability of it being in each cell is known. If resources 


are allocated to some cells, a new distribution over space is 


to be considered after an unsuccessful search, according to 


Bayes' theorem. 


Formally, it is assumed that the following are given: 


a) A set C of states. 


b) A set A of actions. 

c) An apriori distribution P, (c) defined on C with P, (c) 
being the probability that the target is initially in state c. 

dad) A function Q(a,c) being the probability of no detection 
if action a is taken when target is in state c. 

e) A function M(c/d) being the probability that the state 
of the target changes from d to c between actions. Since 
only the current state d is relevant to determine c, the 
target motion is markovian. 

Let Apragr veer a be a sequence of actions. 
Let Py (c) be the probability distribution of the state 
of the target conditioned on non-detection by Ayragr seer a 


t 


and t-l state changes, and P (c) be the probability dis- 


t+l 


tribution conditioned on non-detection by AprAgrerer ay and 


t state changes. 
Then, according to Bayes theorem, 
P.(c)Q(a, rc) 


Pic) = (1) 
bP, (alata, od) 


and according to the motion model 


P,.,(¢) = PPt (a) M(c/a) (2) 
d 


Since P, (c) is given, alternative applications of (1) 
and (2) will provide PY (ce) for all t. 
The probability of detection during period t, conditioned 


on earlier failures is 


Py = ]P, (1 > ofa ia) 
da 
If a, is chosen to maximize PL for te 1,2), .06 In 


t 


succession, then ay is a myopic plan. 


The probability that the target has not been detected 


until the end of the pth period is 


P(T) = P{target not detected at period 1, and not 
detected at period 2, and ..., and not 
detected at period T] 


T T 
P(T) = ff (l= PL) = TT [sP, (d)Q(a,,d)] 
t=1 t=l d 


Then, the probability of detection after T actions 


zr 
P(t) = 1- P(t) = 1- ft ({P, (avota,,a)] 
t=l d 


ay is an optimal plan if it maximizes P(T) for a given 


Optimal plans are highly complex and consequently expen- 
sive to find [1]. In contrast, myopic plans are easy to 
find. 

The myopic strategy may be optimal, as in the case of 
stationary targets, or near optimal, as in most of the exam- 
ples in references [1] and [2]. 

There are however, cases for which myopic plans are 
strongly non-optimal. 

Models are to be constructed and used to reach the main 
goals of this thesis: 

1) Develop and implement an algorithm to find myopic plans. 
2) Create interactive search programs, and 


3) Use them to discover classes of problems for which the 


myopic strategy is strongly non-optimal. 


II. 


THE MODELS AND ASSUMPTIONS 


A. SPACE MODEL 
Space is divided into mxn square cells, each one iden- 
tified by a 2-tuple. The upper left cell is cell (1,1). 


th ceil to the east, hi cell to the south. 


Cell (i,j) is the i 

If it happens that a target cannot move in some directions, 
boundaries can be introduced, either reflecting or absorbing. 
A target cannot cross a reflecting boundary. If one of its 
paths leads to the outside, this path is reflected, i.e., the 
target moves in the opposite direction. Reflecting boundaries 
model, for example, the borders of a channel. An absorbing 
boundary can be crossed from the interior but not from out- 
Side. It models the case in which the target has some infor- 
Mation about the search area and tries to evade. Once it is 
Out, it will never move back into that area. 

By search area it is meant the subset of cells to which 
the searcher is able, allowed or willing to allocate effort 
and that is not necessarily the same subset that the target 


can move across. The latter will be referred to as the target 


area. 


B. DETECTION MODEL 
Sensors are assumed to have an exponential detection 
function, that is, the conditional probability of detection 


has the form: 


l - exp[-a(g,t)x(g,t)], 


where x(g,t) is the amount of search effort allocated to 


cell g at period t and a(g,t) is a non-negative constant 
which may depend on the cell, may change with time, and 


that will be referred to as detection rate. 


C. THE MOTION MODELS 

Two models are used: the random walk in space and the 
random walk in speed. 

In both models, speed is expressed in terms of cells 
per period. 

If a target occupies cell (i,j) and, after a change of 
state it is in cell (i+k,j+%), its speed in the west-east 
direction is Ve * k cells/period, and its speed in the 
north-south direction is vy = %t cells/period 


1. Random Walk in Space 


In this model, Pi (c) = S,(i,3), 1 Gis 7 2 


probability of the target being in cell (i,j). 


¢ (C) is the 


Given the joint distribution of Lae and Vy eS oe 


invariant with time and space, 


Sey, (ie5) = J FS Ue, 2)t, y (ink, 5-2) 
e 4 ee 


The, for this model, 


M(c/a@) 


(isk ,j~2) 
“vyrVy 


where i and j define state c, and the state d is defined by 


k and &. 


2. Random Walk in Speed 


Sets of possible values for Me and VW are fixed. 


2 ee x ae y 
Let V (vp rVp. yar vi} and V {vi 1V5, aietwrd a 


be the sets of possible values that My and Vy can assume. 
P(e) is equal to S. (i,j,k, 2), i.e., P, (c) is the 
probability of the target being in ee]l (i,j), its speed 
having components, ate 


Let P (SV) and P (SV) be the known discrete 


AVY aN 
distributions of AV, and AV the changes in ee and Vy per 


period, respectively. 


Given Pay (OV) a matrix p* can be constructed, which 
x 


entries P; are the probabilities of ve changing from 4 
‘ 


j 
to vy in one period. A similar matrix pY can be constructed 
which entries are the probabilities of the changes in Vy 


Then 


sf 


ae . F ‘ x 
Soy (bed kee) a ) YS, (i-r,j-s.r,S)P, Psy 
rs 
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III. MYOPIC SEARCH PLANS 


Let Pj, i= 1,2, ...,n be the probability of the target 


th of the n cells among which the search effort 


being in the i 
is to be myopically distributed at period t. 

Let X,, i = 1,2, ..., n be the fraction of effort allo- 
cated to each of the cells that are assumed to have a common 
detecticn rate a which may change with periods. 


Given the detection model, a myopic plan maximizes 


TRE 
tp,-8 jy hotly eyo sag 8 


a 


for each t = 1,2, ... in succession. 

The sum of all Xi must not exceed X, the total amount of 
effort available in the period and no x; can be less than 
0. 

Thus, a myopic plan is the solutions of a sequence of 


non-linear programs with the form 


“ax. 


Min ype ’ (1) 
ai 
S/T fx; < X (2) 
i 
at > 0 , i = higas eooee n (3) 


It can be easily proved that equality holds for (2) 
at optimality. 
If the constraints (3) are relaxed and Lagrange method 


is used: 


From (4) 


Sum (6), side by side, over all i: 


nin = { In(ap,) - a PX 
a i 


Substitute X for yx, in (8) and rearrange: 
% 


1 aX 
ln \ ln a+ 4 in[lp,] ee (9) 
i 


Substitute (9) for ln \ in (7): 


ln p, 


lIna i 1 al aX 
* = -_— _— — [= — 
xt + = 5 fin a+ Rin (IP; ) —~_ 
of 
ln p. 
i 1 X : 
x? = m7 wae in[Mp;] + a fe ier ete 


i 
(10) 


Brown [2] proved that the objective function is convex. 


Then (10) is the optimal solution of the N.L.P. (1), (2). 


At optimality, 


p,e = “ = constant for i=1,2, ..., n 


A. ALGORITHM FOR FINDING MYOPIC PLANS 
Provided the detection rate is invariant with cells: 
Step 1) Let I = {i: i = 1,2, ..., n} be the set of 
indexes of all cells among which the search 
effort is to be myopically distributed. 


Step 2) Solve the N.L.P. (1), (2): 


15 


rN 


fasta neceaataRE LA) = Ole 


where P = I Pi and m is the number of elements 
iel 
in I. 
If x; 2 for all ie I, stop. 
Step 3) Select the cell with smallest Pye ie I. Remove 
its index from I and make x, = 0 
Go to step 2. 


-ax* 


At optimality, p. < p.e +s constant, for all j #¢ I, 


J 
alliel. 
The algorithm has at most n interactions. It solution is 


feasible for the N.L.P. (1), (2), (3) since 


and is also optimal. 


Let Z* = Py + P> + ces * Da 


where j+tm = n, be the optimal solution produced by the 
algorithm after reindexing the cells such that Pi < Piay for 
all i. 


Then, the algorithm found 


ln p 
X Le. 
a eae err — 


where 


j+m 
e = 
P ll Pi - 
isj 
Suppose the optimal solution was 


he ax, "8X5 47 
* = 
Z By? By © oes SOL Ry * 9i,1° 
ax, 
j+m 
eee * P54m® : 
In this case, 
-ax! -ax! -ax! 
j jt+l = a j+m 
p,e = P541° Se P54me 
and 
~ t = eS ’ 
in Py ax, In P541 WES ey 
- ' = - ' 
ln Ps ax, ln P542 axs so 
- ‘ = de ' 
ln P, ax, ln P54m aXs im 
Sum side by side: 
j+m j+m 
- ' = = ' 
min p; - amx} L impose | &} 
isj+1 i=j+l 
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j+m 
m in P5 = a(m+1) x: = ln( IJ P;) - aX 


i=jt+l 
m inp, 
e. ie j ) ee ae 
x a (m+ * (m+1) a(m+1) 7 (12) 
where 
j+m 
Pp = II Py 
i=jt+l 
Compare (11) and (12): 
mln p. ln p. 
bes aw ne Bs as 
a (m+1) (m+1) a (m+1) a (m+1) a(m+1) 


Since a(m+l) > 0 


m ln Ps - ln P > (m+l) In P; - ln P' 


inp, > in p, (13) 


Since no xX; Can be made 0 before Xia? (13) proves by 


contradiction that the solution is optimal. 


ore 


IV. THE COMPUTER PROGRAMS 


Two FORTRAN programs were written. 

Program SRCH1 refers to the random walk in space model 
and allows the space to be divided into a maximum of 100x100 
cells. Any subset of cells can be used as target and/or 
search areas. 

In this program, a two dimensional array is defined by 
the FORTRAN name CELL, which entries are the probabilities 
of the target being in each of the cells identified by the 
array indexes. 

Program SRCH2 refers to the random walk in speed model. 

A 25x 25x4x4 array is defined by the FORTRAN name CELL. 

The entries of this array are the probabilities of the 

target being in the cells identified by the first two indexes, 
its speed having the components defined by the last two 
indexes. Thus, this program allows the space to be divided 
into a maximum of 25x 25 cells and allows the sets of possi- 
ble values of vi and Vy to have at most 4 elements each. Any 
subset of cells can be used as target and/or search areas. 

SRCH2 maps the four dimensional array into a two dimen- 
sional array called TCELL, which entries have the same meaning 
as the entries of the array CELL in program SRCH1. 

These two dimensional arrays are printed at the beginning 


of each period, after their entries are coded as follows: 


The highest probability is mapped onto 100; the smallest 


non-zero probability mapped onto 0. 


Probabilities 


Arbitrary Scale 


Fig. Iv~l 


The interval [0,100] is then divided and coded. 


Subinterval Code 


100 ~ 


(99,100) 9 
8 


(96,99) 
(91,96) 
(84,91) 
(75,84) 
(64,75) 
(51,64) 
[36,51) 
[19,36) 
[0,19) 


Probabilities equal 0 are coded as a dot. Fig. IV-2 is 


an example of the coded distribution of the target. 


RANGE OF PROBABILITIES 


27/ 
28/ 
29/ 
30/ 
31/ 
32/ 
33/ 
34/ 
aa/ 
36/ 
atf 
38/ 
39/ 
40/ 


Both programs have a subroutine that distributes myopically 
the search effort, provided the detection rate is invariant 


30 40 50 


0123456789012345678901234 


0000000000000000000000000 
0000000000000000000000000 
0000000011111111100000000 
0000001122233322211000000 
0000011223333333221100000 
0000012234444444322100000 
0000012345677765432100000 
000000124578*875421000000 
0000000123455543210000000 
-00000001122222110000000. 
- -000000000000000000000.. 
«+ +0000000000000000000... 
«++ -00000000000000000.... 
«+ ++-+000000000000000..... 


Fig. IV-2 


with space within the search area. 


Instructions on use of the programs constitute Appendices 
A and B. 


0.29119E-07 0.17087E-01 


V. EXAMPLES AND CONCLUSIONS 


A. EXAMPLES 
Different situations were analysed and some of them are 
now presented. 
1. First Example 
The a priori distribution of a target was uniform 


over a 3x3 cell area as tollows: 


30 | 1/9 0c ee ee 9 
eas 1/9 1/9 \ 1/9 
32 1/9 1/9 1/9 | 


The search areas wasS coincident with the above area and the 
target area was the entire space. 


The target moved as follows: 


Five units of search effort were available and the detection 
rate was one for the cells within the search area, both 


values invariant with time. 


which distributed effort as follows: 


——_—_ 9 


A myopic and an alternative strategy were used 


CELL 
(30,30) 
(31,30) 
(32,30) 
(30,31) 
(31,31) 
(32,31) 
(30,32) 
(31,32) 
(32,32) 


CELL 
(32,30) 
(31,31) 
(32,31) 
(30,32) 
(31,32) 
(32,32) 


PERIOD 1 


STRATEGY 


MYOPIC 
0.5556 
0.5556 
0.5556 
0.5556 
0.5556 
0.5556 
0.5556 
0.5556 
0.5556 


PERIOD 2 


STRATEGY 


MYOPIC 


23 


ALTERNATIVE 


ALTERNATIVE 
0.313 


CELL 
(31,31) 
(32,31) 
(31,32) 
(32,32) 


"i CELL 

(32,31) 
i (31,32) 
H (32,32) 


CELL 
(32,32) 


were: 


PERIOD 3 


STRATEGY 
MYOPIC ALTERNATIVE 
0.6781 - 
1.4071 1.567 
1.4071 1.526 
1.5076 1.907 
PERIOD 4 
STRATEGY 
MYOPIC ALTERNATIVE 
1.4331 1.4241 
7) ae 1.3205 
2.1337 2.2554 
PERIOD 5 
STRATEGY 
MYOPIC ALTERNATIVE 
5.0 5.0 


The probabilities of detection were, after each period 


SS AL Se tne SAA ENN mE EC 


STRATEGY 


PERIOD MYOPIC ALTERNATIVE 
1 0.42624 0.35118 
2 0.60819 0.56827 
3 0.65128 0.69634 
4 0.65790 0.71282 
5 0.65814 0.71338 


After 5 periods the alternative plan yielded a probability 

of detection 8.39% higher. This alternative strategy con- 
sisted in distributing myopically the effort among the cells 
adjacent to the boundaries of the search area in the direction 
of the movement of the target. It made a barrier that the 
target had to cross to leave the search area. 

This example suggested that myopic strategy was 
strongly non-optimal for cases in which the target could move 
to a safe region, and the search lasted long enough for it 
to reach this region. 

This example led to the hypothesis that myopic plans 
were also strongly non-optimal in situations where the target 
moved to areas where the conditional probability of detection 
was a strong function of space, the aforementioned example 
being the extreme case of conditional probability of detec- 
tion equal zero. However, for other analysed problems, in 
which the target could also evade to a safe area, no strate- 


gies could be found that led to a probability of detection 


25 


as much as 4% higher than the probability produced by myopic 
strategies. 
2. Second Example 
The a priori distribution of a target was uniform 


over a 5x4 cell area as follows: 


0.05 


The target area was the subset of cells (i,j) such that 


38 < i < 40, and the search area was such that j < 28. 


The target moved as follows: 


Five units of search effort were available and the 
detection rate was one for the cells within the search area, 


both values invariant with time. 


i a ail hy 


The interesting point about this case is that four 
different strategies turned out to be better than the myopic | 
for a seven peeriod search. 


The strategies distributed effort as follows: 


PERIOD 1 
STRATEGY 

CELL MYOPIC 1 2 3 4 

(40,22) 0.2500 = = = 0.2500 
(41,22) 0.2500 = - = 0.2500 
(42,22) 0.2500 = = = 0.2500 
(43,22) 0.2500 = = = 0.2500 
(44,22) 0.2500 si ~ = 0.2500 
(40,23) 0.2500 = = = 0.2500 
(41,23) 0.2500 = = = 0.2500 
(42,23) 0.2500 = = = 0.2500 
(43,23) 0.2500 = = = 0.2500 
(44,23) 0.2500 — = = 0.2500 
(40,24) 0.2500 = = = 0.2500 
(41,24) 0.2500 > = = 0.2500 
(42,24) 0.2500 = - = 0.2500 
(43,24) 0.2500 = = - 0.2500 
(44,24) 0.2500 = = = 0.2500 
(40,25) 0.2500 1.0000 1.0000 1.0000 0.2500 
(41,25) 0.2500 1.0000 1.0000 1.6000 0.2500 
(42,25) 0.2500 1.0000 1.0000 1.0000 0.2500 
(43,25) 0.2500 1.0000 1.0000 1.0000 0.2500 
(44,25) 0.2500 1.0000 1.0000 1.0000 0.2500 


27 


ee te 


S00! 


CELL 


(40,23) 
(41,23) 
(42,23) 
(43,23) 
(44,23) 
(40,24) 
(41,24) 
(42,24) 
(43,24) 
(44,24) 
(40,25) 
(41,25) 
(42,25) 
(43,25) 
(44,25) 
(40,26) 
(41,26) 
(42,26) 
(43,26) 
(44,26) 


MYOPIC 


0.0360 
0.3927 
0.3927 
0.3927 
0.0360 
0.0360 
0.3927 
0.3927 
0.3927 
0.0360 
0.0360 
0.3927 
0.3927 
0.3927 
0.0360 
0.0360 
0.3927 
0.3927 
0.3927 
0.0360 


PERIOD 2 


STRATEGY 


0.7325 
1.0892 
1.0892 
1.0892 
0.7325 


0.0892 
0.0892 
0.0892 


Se eet ee ee ee vee 


0.7325 
1.0892 
1.0892 
1.0892 
0.7325 


0.0892 
0.0892 
0.0892 


0.0892 
0.0892 
0.0892 


4 


0.0360 
0.3927 
0.3927 
0.3927 
0.0360 
0.0360 
0.3927 
0.3927 
0.3927 
0.0360 
0.0360 
0.3927 
0.3927 
0.3927 
0.0360 
0.0360 
0.3927 
0.3927 
0.3927 
0.0360 


—— a - 


CELL 
(40,24) 
(41,24) 
(42,24) 
(43,24) 
(44,24) 
(39,25) 
(40,25) 
(41,25) 
(42,25) 
(43,25) 
(44,25) 
(45,25) 
(40,26) 
(41,26) 
(42,26) 
(43,26) 
(44,26) 
(40,27) 
(41,27) 
(42,27) 
(43,27) 
(44,27) 


MYOPIC 
0.1406 
0.3229 
0.3229 
0.3229 
0.1406 


0.1406 
0.3229 
0.3229 
0.3229 
0.1406 


0.1406 
0.3229 
0.3229 
0.3229 
0.1406 
0.1406 
0.3229 
0.3229 
0.3229 
0.1406 


PERIOD 3 


STRATEGY 
1 


0.0304 
0.7386 
1.0448 
1.1391 
1.0448 
0.7386 
0.0304 
0.0168 
0.0499 
0.0499 
0.0499 
0.0168 


0.0499 
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2 


0.0304 
0.7386 
1.0448 
1.1391 
1.0448 
0.7386 
0.0304 
0.0168 
0.0499 
0.0499 
0.0499 
0.0168 


0.0499 


0.0304 
0.7386 
1.0448 
1.1391 
1.0448 
0.7386 
0.0304 
0.0168 
0.0499 
0.0499 
0.0499 
0.0168 


0.0499 


4 

0.1406 
0.3229 
0.3229 
0.3229 
0.1406 


0.1406 
0.3229 
0.3229 
0.3229 
0.1406 


0.1406 
0.3229 
0.3229 
0.3229 
0.1406 
0.1406 
0.3229 
0.3229 
0.3229 
0.1406 
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CELL 


(39,25) 
(40,25) 
(41,25) 
(42,25) 
(43,25) 
(44,25) 
(45,25) 
(39,26) 
(40,26) 
(41,26) 
(42,26) 
(43,26) 
(44,26) 
(45,26) 
(39,27) 
(40,27) 
(41,27) 
(42,27) 
(43,27) 
(44,27) 
(45,27) 
(39,28) 
(40,28) 
(41,28) 
(42,28) 
(43,28) 
(44,28) 
(45,28) 


MYOPIC 


0.1854 
0.2930 
0.2930 
0.2930 
0.1854 


0.1854 
0.2930 
0.2930 
0.2930 
0.1854 


0.1854 
- 2930 
- 2930 
- 2930 
-1854 


ooo Oo 


0.1854 
0.2930 
0.2930 
0.2930 
0.1854 
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PERIOD 4 


STRATEGY 
J 2 
0.2006 gs 
0.7037 - 
1.0049 = 
1.0944 = 
1.0049 a 
0.7037 = 
0.2006 = 
- 0.2259 
0.0109 0.3666 
0.0109 0.3666 
0.0109 0.3666 
0.0109 0.3666 
0.0109 0.3666 
= 0.2259 
= 0.0720 
= 0.2691 
0.0109 0.3666 
0.0109 0.3666 
0.0109 0.3666 
5 0.2691 
= 0.0720 
= 0.0144 
= 0.2756 
me 0.3528 
= 0.2756 
- 0.0144 


0.2624 
0.4594 
0.5570 
0.5570 
0.5570 
0.4595 
0.2624 
0.2048 
0.4661 
0.5432 
0.4661 
0.2048 


0.4636 
0.7500 
0.8576 
0.8576 
0.8576 
0.7500 
0.4636 


PERIOD 5 


STRATEGY 


CELL MYOPIC J 

(39,26) 0.1551 0.2487 
(40,26) 0.2537 0.2939 
(41,26) 0.2829 0.2939 
(42,26) 0.2829 0.2939 
(43,26) 0.2829 0.2939 
(44,26) 0.2537 0.2939 
(45,26) 0.1551 0.2487 
(39,27) 0.1551 0.1902 
(40,27) 0.2537 0.2567 
(41,27) 0.2829 0.2939 


oo oreo oOo Oo N 


0.5414 
0.6122 
0.6524 


(42,27) 0.2829 0.2939 0.6524 
(43,27) 0.2829 0.2939 0.6524 
(44,27) 0.2537 0.2567 0.6122 


(45,27) 0.1551 0.1902 0.5414 = 

(39,28) 0.1551 0.0326 0.1294 Q.5131 
(40,28) 0.2537 0.1804 0.0953 0.7177 
(41,28) 0.2829 0.2687 0.0953 0.8357 
(42,28) 0.2829 0.2939 0.0953 0.8668 
(43,28) 0.2829 0.2687 0.0953 0.8357 
(44,28) 0.2537 0.1804 0.0953 0.7177 
(45,28) 0.1551 0.0326 0.1294 0.5131 


CELL 


(39,27) 
(40,27) 
(41,27) 
(42,27) 
(43,27) 
(44,27) 
(45,27) 
(39,28) 
(40,28) 
(41,28) 
(42,28) 
(43,28) 
(44,28) 
(45,28) 


CELL 


(38,28) 
(39,28) 
(40,28) 
(41,28) 
(42,28) 
(43,28) 
(44,28) 
(45,28) 
(46,28) 


MYOPIC 


0.3795 
0.3482 
0.3482 
0.3482 
0.3482 
0.3482 
0.3795 
0.3795 
0.3482 
0.3482 
0.3482 
0.3482 
0.3482 
0.3795 


MYOPIC 


0.1225 
0.7748 
0.6411 
0.6411 
0.6411 
0.6411 
0.6411 
0.7748 
0.1225 


PERIOD 6 


STRATEGY 

1 2 

0.4157 0.5429 
0.3398 0.5177 
0.3398 0.5177 
0.3398 0.5177 
0.3398 0.5177 
0.3398 0.5177 
0.4157 0.5429 
0.3851 0.2164 
0.3398 0.1887 
0.3398 0.1717 
0.3398 0.1717 
0.3398 0.1717 
0.3398 0.1887 
0.3851 0.2164 

PERIOD 7 
STRATEGY 

1 2 

G.1376 6.1797 
0.7845 0.8073 
0.6312 0.6080 
0.6312 0.6080 
0.6312 0.6080 
0.6312 0.6080 
0.6312 0.6080 
0.7845 0.8073 
0.1376 0.1727 


3 


0.3880 
0.6928 
0.9198 
0.9987 
0.9198 
0.6928 
0.3880 


3 


0.0748 
0.7448 
0.6721 
0.6721 
0.6721 
0.6721 
0.6721 
0.7448 
0.0728 


0.5815 
0.7013 
0.7996 
0.8352 
0.7996 
0.7013 
0.5815 
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The probabilities of detection after each period were: 


STRATEGY 
PERIOD MYOPIC l 2 3 4 
1 0.22119 0.15803 0.15803 0.15803 0.22119 
2 0.38064 0.29861 0.29861 0.29861 0.38064 
3 0.49071 0.43139 0.43139 0.43139 0.49071 
4 0.57188 0.55845 0.49688 0.48977 0.55116 
5 0.63270 0.62597 0.62012 0.54531 0.61063 
6 0.67812 0.67652 0.67891 0.66582 0.66948 
7 0.70635 0.70815 0.71475 0.72319 0.72790 


Strategy 4 was 3.05% better than the myopic, for a seven 
period search. This strategy searched myopically for the 
target until it could possibly be in celis adjacent to the 
boundaries of search area, and then, as in the first example, 


concentrated the effort in those cells. 


B. CONCLUSIONS 

Although myopic strategy is strongly non-optimal for 
some specific cases, as the first example in this thesis and 
as the problem which Brown [2] called the Island Passage 
Problem, no classes of problems could be characterized for 
which a strategy could be found that was much better than the 
myopic. 

Many researched problems, the presented examples inclusive, 
show that a strategy which may not be optimal but that concen- 


trates the effort near the boundaries of the search area when 
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the target reaches these boundaries, produces better results 


than a myopic strategy. 

It should be noted that no cases were considered in 
which the detection rate changed with cells within the search 
area and none of the alternative strategies used can be 


guaranteed to be optimal. 


C. EXTENSIONS 

Extensions can be brought into this thesis that may 
possibly lead to the characterization of classes of problems 
for which the myopic strategy is strongly non-optimal. 

First, an algorithm to find optimal plans may be imple- 
mented and added to the computer programs. 

Second, the restriction on the change of detection rate 
with cells within the search area may be removed from the 
myopic plan. 

Further, other motion model as the fleeing datum [1] 
and the geometric memory motion [2] can be used. 

Last, a detection model in which the conditional proba- 
bility of detection is a function of the speed of the target 


can be constructed and used together with the random walk 


in speed model. 


APPENDIX A 


INSTRUCTIONS ON USE OF PROGRAM SRCH1 


The first data the program requires are the limits of 


the target area and types of boundaries. They must have 


the form 


QUANTITY MEANING REQUIREMENTS 

West limit 001<aaa< 100 

East limit 00l<bbb< 100; bbb>aaa 
S¢s North limit 001<cec<100 
ddd South limit 00l<ddd<100; ddd>cce 
www Type of the 
XXX boundary which REF for reflecting 
yyy preceeds each of ABS for absorbing 
$32 these quantities 


Next, the program asks for the limits of the search area. 


The entry must have the form 


aaabbbcccddd 


all quantities with the same meanings and fulfilling the 


same requirements as above. 


Then, the transition matrix is to be introduced. 


If the probability of the target moving from cell (m,n) 


to cell (m+k,n+2%) is Pj, enter 


enter one line for each i, after which, enter @. 


Yp, must be equal to l. 


7 % 
1 


p_ was the format F10.8 


The last entry before calculations begin is the a priori 
distribution of the target, which must have the form, 
where eee and fff identify the cell where the target is with 
probability p # @. 

Enter one line for each p_, after which enter #. _p_ must 
fulfill the requirements previously stated. From this point 
on, all actions are repeated at each period. 

The program prints a table similar to that in Fig. IV-2 
which shows the coded distribution of the target at the 
beginning of the period, and then, asks for the total amount 
of effort available in the period and the detection rate. 
Use format 2F5.3 to introduce these values. 


In case the user does not want a myopic distribution, 


the effort is to be distributed as follows: 


eeefff € 


where eee and fff identify the cell where the amount t_ 
is placed. 

Enter one line for each t_ ¥# 0. 

Summation of all _t_ must add up to the total amount 
of effort available in the period. 

_t has the format F10.8. 

Enter 9 after distributing the search effort. 

Questions must be answered Yes (Y) or No (N) as in the 


following example: 


$ srchl 
EXECUTION BEGINS... 

ENTER LIMITS OF TARGET AREA AND TYPE OF BOUNDARIES 
>025ref030ref020abs025ref 

ENTER LIMITS OF SEARCH AREA 

>025030001100 

ENTER TRANSITION MATRIX 

>000-010.25 

>v000010.25 

>0010000.25 

>-010000.25 

>0 

ENTER A PRIORI DISTRIBUTION OF TARGET 
>0260220.3 

>0260230.4 

>0270230.3 

>0 

RANGE OF PROBABILITIES 0.30000 0.40000 

26 


67 
22/ 0. 
23/ *0 
ENTER TOTAL EFFORT AND DETECTION RATE 
>3.0001.000 
MYOPIC PLAN? 
>Y 


Serre ‘ . 
nh el Ee oe cen = as eae A, 


WANT TO KNOW DISTRIBUTION OF EFFORT? 
>Y 

CELL EFFORT 

26 22 0.9041 

26 23 1.1918 

27 23 0.9041 

AFTER 1 PERIODS, PROB DET IS 0.63559 
WANT TO CONTINUE? 
>Y 

RANGE OF PROBABILITIES 0.833333$-01 

25 
5678 

21f «Ge 

22/ 00*. 

23/ 0*00 

24/ .00. 

ENTER TOTAL EFFORT AND DETECTION RATE 
>3.0001.000 

MYOPIC PLAN? 
>n 

ENTER DISTRIBUTION OF SEARCH EFFORT 
>0270221.5 
>0260231.5 
>0 

AFTER 2 PERIODS, PROB DET IS 0.72995 
WANT TO CONTINUE? 
>n 

WANT TO PLAY AGAIN? 
>n 
R; T=4.73/9.44 13.30.46 


> 


0.16667 


} APPENDIX B 


INSTRUCTIONS ON USE OF PROGRAM SRCH2 


The first data the program requires are the limits of 
the target area and types of boundaries. They must have 


the form 


A EA ARE A ae a 
» 
Q 


QUANTITY MEANING REQUIREMENTS 

aa West limit Ol<aa<25 

bb East limit Ol<bb<25; bb>aa 

ce North limit Ol<ce<25 

dd South limit Ol<dd<25; dd>cc 

www Type of the 

XXX boundary which REF for reflecting 
yyy preceeds each of ABS for absorbing 
Z2z these quantities 


Next, the program asks for the limits of the search area. 
The entry must have the form 

aabbccdd 
All quantities with the same meanings and fulfilling the 
same requirements as above. 

Then, the program asks how many different values 7. can 
assume. Any positive integer less than 5 can be introduced, 


according to Format I2. 


Use the same format to introduce the values of Vie one 


per line. 


The same question is made with respect to Ve and the 
same instructions used for Me apply. 

Next, the transition matrix of LP is to be introduced. 
Type 

22.2 
where ee is the value AV, can assume with probability _p . 
Enter one line for each p_, after which, enter @. 
Summation of all _p_ must be l. 
_p_ has the format F5.3. 

The transition matrix for Vy is introduced in accordance 
with the same rules stated for 

The last data before calculations begin is the a priori 


distribution of target, which must have the form 


tige FU 8 ee Fd Se oes 


where ff and gg identify the cell where the target is with 
probability p. 


4, 42 ... are the conditional distribution of Vir de Qienp 


x x 
1 ’ ¥o ‘ 
is in cell (ff,gg). The number of quantities g must be 


the probabilities of Vy being v .. given the target 
equal to the number of possible values that ie can assume. 
The summation of all q must be 1. The quantities rare 
the conditional distribution of Vy. 
The format for quantities p, gq and _r_ is F5.3. 
Enter one line for each _p_ # 0, after which enter @. 
Summation of all _p_ must be one, too. 


From this point on, all actions are repeated at each period. 
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The program prints a table similar to that in Fig. IV-2 
which shows the coded distribution of the target at the 
beginning of the period, and then, asks for the total amount 
of effort available in the period and the detection rate. 

Use format 2F5.3 to introduce these values. 

In case the user does not want a myopic distribution, 


the effort is to be distributed as follows: 
ffgg_t_ 
where ff and gq identify the cell where the amount t_ 
is placed. 
Enter one line for each t # 0. 
Summation of all _t_ must add up to the total amount of 
effort available in the period. : 
_t has the format F1l0.8 
Enter @ after distributing the effort 
Questions must be answered Yes (Y) or No (N) as in the 


following example: 


>$ srch2 
EXECUTION BEGINS... 

ENTER LIMITS OF TARGET AREA AND TYPES OF BOUNDARIES 
>lOreflS5SrefOlref25ref 

ENTER LIMITS OF SEARCH AREA 
>01250125 

HOW MANY VALUES CAN V(X) ASSUME? 
>03 

ENTER THESE VALUES, ONE PER LINE 
>-1 

>00 

>01 

HOW MANY VALUES CAN V(Y) ASSUME? 
>04 

ENTER THESE VALUES, ONE PER LINE 
>-1 

>00 

>Ol1 

>02 
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ENTER TRANSITION OF V(X) 
>-10.3 

>000.4 
>010.3 
>0 

ENTER TRANSITION OF V(Y) 
>010.8 

>020.2 

>0 

ENTER A PRIORI DISTRIBUTIONS 
>12120.3000.4000.3000.3000.1000.2000.3000.400 
>12130.4000.5000. 2000. 3000.6000.2000.1000.100 
>13140.3000.4000. 4000. 2000.5000.3000.1900. 100 
>0 

RANGE OF PROBABILITIES 0.30000 0.4000 

12 


23 
49/ 6. 
137 *, 
14/ .0 
ENTER TOTAL EFFORT AND DETECTION RATE 
>1.0001.000 
MYOPIC PLAN? 
>Y 
WANT TO KNOW DISTRIBUTION OF EFFORT? 
>Y 
CELL EFFORT 
434204 «66.3374 
12 15. 0.5251 
13 14 (062374 
AFTER 1 PERIODS, PROB DET IS 0.2902 
WANT TO CONTINUE? 
a 
RANGE OF PROBABILITIES 0.66667#-02 0.12667 


16/ .000 
ENTER TOTAL EFFORT AND DETECTION RATE 
>1.0001.000 
MYOPIC PLAN? 
>n 
ENTER DISTRIBUTION OF SEARCH EFFORT 
>11120.7 
>13130.3 
>0 
AFTER 2 PERIODS, PROB DET IS 0.3569 
WANT TO CONTINUE 
on 
WANT TO PLAY AGAIN? 
n 


R; &=7.10/8.93 14.06.39 
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PROGRAM SRCH1 
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